doi: 10.17586/2226-1494-2022-22-3-594-599


Web app for quick evaluation of subjective answers using natural language processing

M. Thalor, M. Pradeep, M. Vishaka


Read the full article  ';
Article in English

For citation:
Meenakshi Anurag T., Pradeep B.M., Vishaka M. Web app for quick evaluation of subjective answers using natural language processing. Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2022, vol. 22, no. 3, pp. 594–599. doi: 10.17586/2226-1494-2022-22-3-594-599


Abstract
In current digital climate, education sector is evolving as the computer technology advances. Education is being digitized: online classes, online examination methods are conducted, etc. During examination, students are assessed by their answers having given for the question set by a teacher. Today many tools are available to assess the performance of a student using multi choice questions tools which provide instant evaluation, but there are available very limited and operational tools where subjective type answer of students are evaluated. This paper presents a web-based application to address this challenge. It automates the process of subjective answers checking and generates results through using natural language processing methods, like keyword matching semantic, lexical analysis and cosine similarity. Experiments show that appreciated by the teacher result and the system estimation does not have much difference which signifies that the system evaluates answers with a 97 % accuracy. The presented system not only reduces manpower but also eliminates the traditional method of conducting exclusively subjective exams using paper documents. It also eliminates the delays in the paper checking, result generation process. The cases of information leak are being reduced and the objectivity of the assessment is being increased.

Keywords: cosine similarity, information extraction, keyword matching, natural language processing

References
  1. Lakshmi V., Ramesh V. Evaluating students’ descriptive answers using natural language processing and artificial neural networks. International Journal of Creative Research Thoughts – IJCRT, 2017, vol. 5, no. 4, pp. 3168–3173.
  2. Patil S.M., Patil S. Evaluating student descriptive answers using natural language processing. International Journal of Engineering Research & Technology (IJERT), 2014, vol. 3, no. 3, pp. 1716–1718.
  3. Yin W., Kann K., Yu M., Schütze H. Comparative study of CNN and RNN for natural language processing. ArXiv, 2017, arXiv:1702.01923. https://doi.org/10.48550/arXiv.1702.01923
  4. Kate A., Kamble S., Bodkhe A., Joshi M. Conversion of Natural Language Query to SQL Query. Proc. of the 2nd International conference on Electronics, Communication and Aerospace Technology (ICECA), 2018, pp. 488–491. https://doi.org/10.1109/ICECA.2018.8474639
  5. Thangarasu S., Sasikala D. Extracting knowledge from XML document using tree-based association rules. Proc. of the International Conference on Intelligent Computing Applications (ICICA), 2014, pp. 134–137. https://doi.org/10.1109/ICICA.2014.37
  6. Mati D.N., Ajdari J., Raufi B., Hamiti M., Selimi B. A Systematic mapping study of language features identification from large text collection. Proc. of the 8th Mediterranean Conference on Embedded Computing (MECO), 2019, pp. 8760042. https://doi.org/10.1109/MECO.2019.8760042
  7. Cai J., Li J., Li W., Wang J. Deeplearning model used in text classification. Proc of the 15th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), 2018, pp. 123–126. https://doi.org/10.1109/ICCWAMTIP.2018.8632592
  8. Tan M., Santos C., Xiang B., Zhou B. Improved representation learning for question answer matching. Proc. of the 54th Annual Meeting of the Association for Computational Linguistics (ACL), 2016, pp. 464–473. https://doi.org/10.18653/v1/P16-1044
  9. Lan Y., Wang S., Jiang J. Knowledge base question answering with a matching-aggregation model and question-specific contextual relations. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2019, vol. 27, no. 10, pp. 1629–1638. https://doi.org/10.1109/TASLP.2019.2926125
  10. Grappy A., Grau B., Falco M-H., Ligozat A-L., Robba I., Vilnat A. Selecting answers to questions from Web documents by a robust validation process. Proc. of the IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, 2011, pp. 55–62. https://doi.org/10.1109/WI-IAT.2011.210
  11. Lan Y., Wang S., Jiang J. Knowledge base question answering with a matching-aggregation model and question specific contextual relations. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2019, vol. 27, no. 10, pp. 1629–1638. https://doi.org/10.1109/TASLP.2019.2926125
  12. Zhang W., Ming Z., Zhang Y., Liu T., Chua T. Capturing the semantics of key phrases using multiple languages for question retrieval. IEEE Transactions on Knowledge and Data Engineering, 2016, vol. 28, no. 4, pp. 888–900. https://doi.org/10.1109/TKDE.2015.2502944
  13. Pakray P., Pal S., Bandyopadhyay S., Gelbukh A. Automatic answer validation system on English language. Proc. of the 3rd International Conference on Advanced Computer Theory and Engineering, 2010, pp. V6329–V6333. https://doi.org/10.1109/ICACTE.2010.5579166
  14. Thalor M.A. A descriptive answer evaluation system using cosine similarity technique. Proc. of the 4th International Conference on Communication information and Computing Technology (ICCICT), 2021. https://doi.org/10.1109/ICCICT50803.2021.9510170
  15. Mandge V.A., Thalor M.A. Revolutionize cosine answer matching technique for question answering system. Proc. of the International Conference on Emerging Smart Computing and Informatics (ESCI), 2021, pp. 335–339. https://doi.org/10.1109/ESCI50559.2021.9396864


Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License
Copyright 2001-2024 ©
Scientific and Technical Journal
of Information Technologies, Mechanics and Optics.
All rights reserved.

Яндекс.Метрика